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(57) Abstract 

A system for separating mixed signal sources by processing a 
received signal through the combination of a beam-forming network 
(Fig. 5) and an adaptive Herault-Jutten network (72). The system 
(Fig. 1 1) combines planar beam-forming techniques with a conventional 
HJ network (72) to adaptively distinguish among signals having delays 
introduced by the propagation medium. A new sensor filter (62) 
scheme is introduced to eliminate beam-forming variation with frequency 
over the band of interest The resulting system has application to 
adaptive interferer rejection and to acoustic and cellular communications 
receivers. 
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DESCRIPTION 

AN ADAPTIVE SYSTEM FOR BROADBAND MTITTTSTGNAT 
DISCRIMINATION IN A CHA NNEL WITH REVERBERATION 

TECHNICAL FIELD 
5 This invention relates to systems for discriminating among multiple signals 

to recover information and, more specifically, to an adaptive system for recovering 
a signal from among several signal sources in a channel having reverberation. 

BACKGROUND ART 

The separation of independent sources from an array of sensors is a classic 

10 but difficult problem in signal processing. Generally, the signal sources as well 
as their mixture characteristics are unknown. Without knowledge of the signal 
sources other than the general assumption of source independence, the signal 
processing problem is denominated "blind separation of sources". The separation 
is "blind" because nothing is known about the frequency or phase of the 

1 5 independent signals. 

A concrete example of the blind separation of sources problem is where the 
pure (source) signals are sounds generated in a room and the mixed (sensor) 
signals are the outputs of several microphones (Fig. 1). Each of the pure signals 
is delayed and attenuated in some manner during transmission from source to 

20 microphone, where it is then mixed with other delayed and attenuated source 
signals. Multipath signals ("ghosts" created by reverberation) are delayed versions 
of the source signals arriving from different directions. This is denominated the 
"cocktail party" problem, where a person wishes to listen to a single sound source 
while filtering out other interfering sources including those created by 

25 reverberation. 
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Practitioners in the signal processing arts have pursued solutions to the 
blind source separation problem because of their broad application in many fields. 
For instance, in underwater acoustic digital communication, a receiver must 
eliminate multipath or reverberating versions of the transmitted signal to avoid 
5 unacceptable levels of intersymbol interference. The same multipath distortion 
problem is also well-known in the cellular telecommunications art. 

Because the human ear automatically performs blind source separation, 
some practitioners have explored the neural network art for solutions to the blind 
separation of sources problem. For instance, Christian Jutten, et al ("Space or 

10 Time Adaptive Signal Processing By Neural Network Models", Neural Networks 
for Computing, Snowbird. TJT. J.S. Denker, Ed., AIP Conference Proceedings 151, 
pp. 207-21 1, 1986) first introduced a simple neural network, herein denominated 
the Herault-Jutten (HJ) network, with adaptive separation capability. 

Since its introduction, the HJ network has been extensively studied by 

15 practitioners in the art. For a detailed discussion of the HJ network, reference is 
made to C. Jutten, et al, "Blind Separation of Sources, Part I: An Adaptive 
Algorithm Based On A Neuromimetic Architecture", Signal Processing 24(1), pp. 
1-10 (1991). Jutten, et al show that their HJ network can provide an exact 
solution to the blind source separation problem provided that the signal mixtures 

20 are linear and that the number of independent sensors is at least equal to the 
number of sources. Unfortunately, it is not commonly possible to obtain N distinct 
linear combinations of N signals without delays or phase shifts. This is especially 
the case in channels with reverberation. To generate N full-rank linear 
combinations of inputs for the HJ network, microphones must be placed at N 

25 different locations for signal sources located at N different places (Fig. 1). The 
propagating medium between the N sources and the N sensors produces different 
weights on the different source signal arrivals at each sensor and introduces 
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significant signal delays that cannot be accommodated by the conventional HJ 
network. 

For a statistical explanation of the HJ network function and a discussion of 
a non-adaptive version of the HJ network, reference is made to Pierre Comon, et 
al "Blind Separation of Sources, Part II: Problem Statement", Signal ProcgsaBg 
24(1), pp. 11-20 (1991). Comon, et al observe that the HJ network actually 
functions by searching for common zeros of N functional through pipelined 
stochastic iterations. They show that it relies on the assumed independence of 
sensor signals, which follows from the assumption of independent source signals 
only if the sensor signals are linear combinations of the source signals. They 
observe that any introduction of non-linearity changes the problem to one requiring 
solution of an overdetennined system of non-linear equations with several 
variables; a class of very difficult problems. 

For a discussion of the stability of the HJ network, reference is made to E. 
Sorouchyari, "Blind Separation Sources, Part HI: Stability Analysis, Signal 
accessing 24(1), pp. 21-29 (1991). Sorouchyari shows that using simple linear 
and cubic HJ network adaptation functions f(x) and g(x) offers convergence and 
stability that cannot be improved through the use of higher order non-linear 
adaptation functions. 

For an extensive discussion of a monolithic circuit implementation of the 
HJ network and a review of HJ network operation, reference is made to Marc H. 
Cohen, et al, "Analog VLSI Implementation of An Auto-Adaptive Network for 
Real Time Separation of Independent Signals", Advances in Neural Information 
Processing Systems, Vol. 4, Morgan-Kaufmann, San Mateo, CA (1992). 

Because of the difficulty of ensuring linear combinations of source signals 
at the sensor outputs, the problem of separating non-linear signal combinations is 
of great interest. For instance, John G. Proakis ("Adaptive Equalization 
Techniques For Acoustic Telemetry Channels", IEEE Journal nf n^ni. 
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Engineering, Vol. 16, No. 1, pp. 21-31, Jan 1991) provides a tutorial review of 
adaptive equalization techniques for reducing intersymbol interference in high- 
speed digital communications over time-dispersive channels. Also, Jeffrey H. 
Fischer, et al ( n A High Data Rate, Underwater Acoustic Data-Communications 
5 Transceiver", IEEE Oceans 92. Vol. 2, pp. 571-576, 1992) describe an underwater 
high-speed data communications transceiver that features direct-sequence spread- 
spectrum encoding to mitigate intersymbol interference arising from reverberation 
in shallow acoustic channels. Neither Proakis nor Fischer, et al propose 
multichannel blind separation as a model for reducing intersymbol interference. 

10 Both practitioners rely on frequency redundancy in the signals; the classical 
adaptive techniques they advocate either treat multipath signals as noise or rely on 
embedded training signals and enormous computational complexity. Except for 
the nonlinearity rising from time delays over the source-to-sensor path, the HJ 
network offers a superior and simpler solution to the intersymbol interference 

15 problem. 

Accordingly, John C. Piatt, et al ("Networks For The Separation of Sources 
That Are Superimposed and Delayed", Advances in Neural Information Processing 
Systems, Vol. 4, Morgan-Kaufmann, San Mateo, CA, 1992) have proposed 
extending the HJ network to also estimate a matrix of time delays while estimating 

20 the HJ network mixing matrix. Piatt, et al have proposed a new network to 
separate signals that are mixed either with time delays or through filtering. They 
show that the Herault-Jutten learning rules fulfill a minimum output power 
principle, which they then apply to their extension. However, Piatt, et al also note 
that their learning technique has multiple stable states and they cannot predict 

25 convergence to a solution except through experimentation. 

Accordingly, a reliable and useful method for coping with unknown delays 
in the blind separation of sources problem is a clearly-felt need in the art The 



WO 94/29967 



PCT/US94/06504 



5 

related unresolved problems and deficiencies are clearly felt in the art and are 
solved by this invention in the manner described below. 

DISCLOSURE OF INVENTION 

The system of this invention adds directionality to the sensor response as 
5 a technique for coping with unknown source signal delays at the sensor. A linear 
array of sensors is used to produce N fixed beam lobes without phase shifts. 
Reverberation is thereby reduced (spatially filtered) so that multipath signals may 
be treated as independent sources. 

This is the equivalent of having N virtual directional sensors at a single 

1 0 spatial location, with each oriented to a different direction. If N signal sources are 
located such that each lies in a different direction from the M>N collocated 
sensors, then M full-rank linear combinations of N signals are formed as required 
for the HJ network. Each sensor output may be filtered to equalize for variations 
in beamlobe response over a predetermined frequency range. 

15 It is an object of this invention to extend the HJ network to compensate for 

nonlinearity in source signal combinations arising from source signal propagation 
delays at the sensor. It is an advantage of the system of this invention that adding 
linear array beamforming processing to the HJ network eliminates intersymbol 
interference arising from unknown source signal time delays. 

20 It is another object of this invention to adaptively separate signals that are 

unknown in location, frequency and time delay. It is an advantage of this 
invention that HJ network adaptation procedure readily converges to a stable 
solution to the blind separation of source problem once the propagation medium 
time delays are removed through beamformer processing. 

25 It is yet another advantage of the system of this invention that there is no 

performance penalty for long impulse responses caused by long propagation delays. 
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It is a further advantage of the system of this invention that no training signals are 
needed for equalization because the HJ network is self-training. 

The foregoing, together with other objects, features and advantages of our 
invention, will become more apparent when referring to the following 
5 specification, claims and the accompanying drawing. 

BRIEF DESCRIPTION OF DRAWING 

The objects, advantages and features of this invention will be more readily 
appreciated from the following detailed description, when read in conjunction with 
the accompanying drawing, in which: 
10 Fig. 1 illustrates the blind separation of sources problem from the prior art; 

Fig. 2 comprising Figs, 2A-2D, shows several embodiments of the Herault- 
Jutten network from the prior art; 

Fig. 3 shows the problem of Fig. 1 recast in accordance with the system 
of this invention; 
15 Fig. 4 shows a linear sensor array from the prior art; 

Fig. 5 shows an illustrative embodiment of the linear sensor array 
beamforming network used in this invention; 

Fig. 6, comprising Figs. 6A and 6B, shows array beam power versus 
operating frequency with simple Gaussian shading for sensor compensation; 
20 Fig. 7, comprising Figs. 7A and 7B, compares the effects of applying the 

system of this invention to a first example problem; 

Fig. 8 shows array beam power versus operating frequency with the sensor 
frequency compensation of this invention; 

Fig. 9 shows gain amplitude versus operating frequency for the plurality of 
25 sensor compensation filters of this invention required in an illustrative linear sensor 
array; 
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Fig. 10 shows the sensor array transfer function provided by the illustrative 
FIR filter embodiment of Fig. 9; 

Fig. 1 1 provides a functional block diagram of the system of this invention; 

Fig. 12 provides a simple flow chart illustrating the signal recovery method 
5 of this invention; and 

Fig. 13 shows an illustrative estimation matrix convergence pattern for a 
2x2 HJ network. 

BEST MODES FOR CARRYING OUT THE INVENTION 

The Blind Separation of Sources Problem 

10 Fig. 1 shows an exemplary arrangement for the blind separation of signal 

sources problem. Three independent Talkers are generating three independent 
source signals. Three Microphones are positioned in three different locations. 
Each Microphone produces a single electrical output signal (not shown) 
corresponding to a linear combination of the three signals from the Talkers. These 

15 three microphone signals are independent because the three Microphones are 
located independently. Unfortunately, at each Microphone, each Talker signal has 
a different time delay with respect to its actual source signal. For instance, the 
signal from Talker B at Microphone B has a different propagation delay than the 
signal from Talker B at Microphone C. Since these delay differences are unknown 

20 in the "blind" separation problem, the simple additive model of interference 
assumed by the Herault-Jutten (HJ) network is then not adequate to recover the 
original source signals. 

Fig. 2A shows a functional representation of a NxN HJ network 20 from 
the prior art. Fig. 2B shows a detailed functional diagram of the NxN HJ network 

25 of Fig. 2A. Fig. 2C shows a simple functional diagram of a 2x2 HJ network from 
the prior art. Fig. 2D shows an extended version of the 2x2 HJ network of Fig. 
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2C first proposed by Piatt, et al in the above-cited reference for application to the 
blind source separation problem with delays (Fig. 1). 

HJ network 20 is an N by N network that can be used to solve a signal 
processing problem described as follows: Given N observed data sequences that 
are distinct linear combinations (full rank) of N physical independent signals 
without time delays or phase shifts, network 20 can adaptively recover the N 
physical signals without prior knowledge of the linear mixing matrix relating the 
two groups of signals. This is expressed in mathematical form as: 
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[Eqn. 1] 
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where {E ; (t)} are the known observed data, [AJ is an unknown full rank matrix 
and {Sj(t)} are the original source signals to be recovered. HJ network 20 is a 
memoryless system, as may be appreciated by examining Eqn. 1. Thus, at any 
given time t=t„ the output [££,)] depends only on [S/t,)] and not on any other 
past or future values of [S/t)]. Note also that E ; (t) is a linear combination of 
{S,(t), ... , S^t)}, which are presumed independent of one another, and the 
mixing matrix [A^] is nonsingular. Herein, {EJ denominates an unordered set 
of elements Ej, and jEJ denominates an ordered vector of elements, Ej. 

HJ network 20 functions by defining a transform matrix [q,] as follows: 

TO . . . c. 



[Eqn. 2] 
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The outputs of HJ network 20 are the estimated source signals, {Yj(t)}, 
which are equal to {S/t)} when the transform matrix coefficients stabilize at a 
solution to the blind source separation problem. This estimation can be written as: 
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5 where [I] is the identity matrix having "zero" off-diagonal terms and "unity" 
diagonal tenns. The transform matrix elements {c y } are adjusted over time in 
accordance with an adaptive rule expressed as: 

dc~ 

^nfiE^Ej) [Eqn.4] 

where f(E) and g(E) are different odd functions selected according to a Heppian 
10 learning rule to provide rapid convergence to a solution. These are odd 
adaptation functions because they must preserve the assumed zero mean 
condition and their product must constitute a test for independence. Several 
practitioners have suggested making f(E) = E 3 and g(E) = E. The value of \i 
sets the speed of adaptation over time. When the HJ network learning 
15 approaches an equilibrium point, Y/t) approaches S/t). At the solution point, 
[I+C] is equal to the mixing matrix [A] multiplied by some diagonal gain 
matrix and some permutation matrix. Thus, after convergence, each output of 
HJ network 20 is proportional to (or equal to) only one initial source signal 

Fig. 2B shows a detailed functional embodiment of HJ network 20 from 
20 Fig. 2A. An exemplary transform estimator element 22 is shown in the inset area. 
The i* estimated source signal S, is fed back as the kernel of the adaptor function 
f(x). Similarly, the j* estimated source signal S } is also fed back through the 
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network as the kernel the second adaptor function g(x). The product of these two 
adaptation functions is then weighted and subtracted from the stored value of the 
appropriate element c^ (Eqn.4). The transform element c^ is presented to a 
multiplier 24 where it is multiplied by the i* input signal E { . The resulting product 

5 is then added to the bus 26, where it is summed into a new value of the j A output 
signal Sj. This process can be appreciated with reference to Eqns. 3-4 and the 
above-cited Cohen, et al reference. 

Fig. 2C shows a 2x2 HJ network representation, where the dashed arrows 
represent adaptation. In similar format, Fig. 2D shows another embodiment of the 

10 HJ network adapted to separate signals mixed with single delays. The dashed 
arrows represent adaptation and the source of the arrow is the source of the error 
used by gradient descent The adjustable delay 28 avoids the degeneracy in the 
learning rule arising when attempting to solve the blind source separation problem 
shown in Fig. 1. This network can handle some simple delayed interference 

15 problems, while the HJ networks of Fig. 2B-2C cannot. The performance of this 
extended HJ network can be understood with reference to the above-cited Piatt, et 
al paper. 

An Adaptive Network Extension Using Directional Separation 

The system of this invention redefines the blind source separation problem 
20 of Fig. 1 and casts it as shown in Fig. 3. The same three Talkers are positioned 
as in Fig. 1 but the three Microphones are shown collocated with directionality 
rather than distributed as in Fig. 1 . Normally three collocated Microphones cannot 
provide three independent linear combinations of the signals from Talkers A-C. 
However, the system of this invention introduces a beamformer to form multiple 
25 beamlobes using the three microphone outputs. These multiple beams represent 
independent signals that are propagated from different directions. Each such 
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spatial beam output signal is a distinct linear combination of S/t), as is required 
by the HJ network represented in Eqn. 1. 

Because HJ network 20 cannot remove time delays or phase distortions, the 
beamformer of this invention must not introduce phase changes in the received 
5 signals. Moreover, this "zero phase" requirement must be satisfied over the entire 
operating frequency range of interest. That is, the beamfonner of this invention 
must process each Sj(t) over a predetermined frequency range of interest without 
variation in signal phase shift. This beamformer is now described below. 

Referring to Fig. 4, a row of sensors, exemplified by sensor 30, are 
10 uniformly spaced at distance d to form a sensor array 32. Because the number of 
sensors is equal to 2M+1, where M is an integer, sensor array 32 is symmetrical 
about the center element 30. If the signal 34 from center element 30 is defined 
as E 0 (t), a spatial beam signal Bj(t) is formed by adding time delays T- to the 
output of each sensor and adding them up such that: 

15 Bffir E Pqn. 5] 

where B/t) is the j* spatial beam signal oriented at angle B } with respect to the 
array normal, E m (t) is the output of the m* sensor counting from center element 
30, and b m is the m* shading multiplier used in forming the beam, exemplified 
by multiplier 36 in Fig. 5. The relationship between the signal time delay Tj 
20 and the spatial beam stealing angle 6 } is: 

r.=-sin0. [Eqn. 6] 



where 0j is the main beamlobe angle with respect to the array normal as shown 
in Fig. 4. Fig. 5 provides a functional block diagram of the beamfonner for the 
array of Fig. 4. 
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Assuming that a plane-wave source signal S { (t) is arriving from an angle 
0i'(Fig. 4), the output of the m* sensor is: 

where ij m is a scalar transducer gain for the m* sensor and Tj (see Eqn. 6) is the 
5 time delay between neighboring sensors arising from the finite wave 
propagation velocity c in the medium along the path from the direction of the 
i* source signal Sj(t). If Eqn. 7 is substituted into Eqn. 5, the resulting 
relationship: 

10 shows the fraction of source signal S { that is received in the j* spatial beam 
signal Bj(t). 

Eqn. 8 shows that the beam direction can be steered by changing r y If the 
sensor weights b m and ij m are symmetric with respect to center sensor signal 34, 
then b m =b. m and ij m =ij. m . If b 0 ij 0 =l, then the Fourier transform of Eqn. 8 is: 

M 

=5.(<o) l+2£ ^ m cos[mo)(r r T.)] 

m=l 

B^S^a^u) [Eqn. 9] 

Because a^(co) in Eqn. 9 has no imaginary component, there are no phase shifts 
or delays introduced in Bj(co) for any values of co, Tj or t { . Thus, the symmetry 
20 of the sensor array 32 with respect to central sensor signal 34 eliminates the 
phase shifts between the several spatial beam outputs Bj. If exact delay lines are 
used to form the beam, the phase shifts of the -m* and +m th sensor outputs must 
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cancel exactly. 

For narrow-band signals centered at co 0 , {afl(a> 0 0} from Eqn. 9 can be 
considered to be substantially constant over the narrow bandwidth. For I incoming 
signals from different angles 0 t , one may form N>I separate beams by selecting N 
5 sets of delays t } for N different but fixed directions. These beam signals represent 
N linear combinations of the I narrow-band source signals without delays and these 
combinations may then usefully serve as inputs to an adaptive network such as a 
HJ network. This arrangement is equivalent to having N virtual directional 
microphones at single location at central sensor 30, each aimed in a different 

10 direction. If all original narrow-band source signals are located in different 
directions, N full-rank linear combinations of I signals are formed as required for 
the HJ network. In the time domain, Eqn. 9 has the same form as Eqn. 1, where 
{a^fao)} are the elements of the mixing matrix [AJ. 

A conventional HJ network (Fig. 2A) uses amplitude differences to form 

15 the different elements {c^} of the transform matrix [C l3 ]. The system of this 
invention relies on differences in spatial beam signal magnitudes representing 
linear combinations of signals arriving from different directions. Passing I<N of 
the N beamformer outputs {Bj(t)} through an I by I HJ network recovers the I 
original signals {S,<t)} when the HJ network stabilizes at an equilibrium. 

20 Obtaining Broadband Distortion-Free Spatial Beam Signals 

The separation of multiple broadband signal sources is not feasible with the 
beamformer described above in connection with Fig. 5 because the directional 
sensitivity of sensor array 32 varies with operating frequency. In such case, each 
a^(o>) in Eqn. 9 varies with frequency and Eqn. 9 is no longer equivalent to Eqn. 1 

25 for broadband signals. However, the system of this invention corrects this problem 
by adding a filter element to each of the weighting multipliers exemplified by 
multiplier 36 in Fig. 5. With this approach, it should be possible to construct a 
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beamformer whose beamlobe width is frequency-invariant over a predetermined 
frequency bandwidth. Substituting the necessary filter characteristic h^t) for the 
m A sensor element in Eqn. 8 yields: 

£ r lJ l m( t )* S { t - m (Tj-T i )] [Eqn. 10] 

5 where * indicates convolution. In the frequency domain, Eqn. 10 adopts the 
form: 



At 

1+2 E iA^^M 



[Eqn. 11] 



where the array symmetry assumption is extended to H^u) = H_ m (o>) and the 
expression in brackets is real as in Eqn. 9. 

10 Fig. 6A shows the family of curves representing the mainlobe beam patten 

from "zero frequency" (curve 38) to 8 kHz (curve 40) for an exemplary 25- 
element array (not shown) with Gaussian-window shading at a single-frequency co 0 
according to Eqn. 12 below. Fig. 6B shows the same information displayed in 
three dimensions to better illustrate the beam-narrowing effect of increased 

15 operating frequency. Frequency dependence of transducer constants and related 
effects are ignored in this illustration. The system of this invention adds filters 
{HjJ to the individual sensor elements as necessary to cancel the beamlobe 
frequency-dependence shown in Fig. 6B, thereby obtaining the frequency-invariant 
beam pattern exemplified by the three-dimensional illustration in Fig. 8. Selecting 

20 the filter characteristics necessary to perform this array equalization function 
should result in complete cancellation of time and phase delays in the sensor array 
beam signals {Bj} over a predetermined operating frequency range. The beam 
signal characteristic shown in Fig. 8 provides the linear combination of source 
signals necessary for proper convergence of the HJ network (Figs. 2A-C). 
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The filter transfer functions {!!,»} should be selected so that {B } (o>)} 
(Eqn. 1 1) are independent of o> over the predetermined signal bandwidth interval 
(o^. There are many useful ways to parameterize Hj». The method of this 
invention preferred for achieving this objective is now described. 

First, a frequency Wo is chosen such that w^oS&v At frequency a> 0 , the 
outputs of the sensors are weighted by a Gaussian window function to reduce 
sidelobes. This function is written: 



K =H J.<* 0 )=e °° [Eqn. 12 ] 

At frequencies immediately adjacent <o 0 , the following cost function is 
mimmized at each frequency w over a range of steering directions represented by 
time delays from 7=0 to t=t 0 : 

[a(G)),^o)),Y(u)] = 



f\M 

mini £ 

«Ay J L=i 



ar S mm J £ e • cos(m (* 0 T)-(ye a +S)cos(mo)T) 



2 



dr, [Eqn. 13] 



Next, the transfer function Hm(«) of the filter for the m* sensor is found: 

-m 2 

15 iT,(»)-y(»)ff -C-MCw) [Eqn. 14] 

Fig. 9 shows a set of computed transfer functions {HJco)} over a frequency 
band from 5 kHz to 20 kHz for each sensor in an exemplary 25 element array, 
from m=0 (curve 46) to m=12 (curve 48). The transfer functions in Fig. 9 are 
sufficient to equalize a 2M+1 = 25-element array. At lower frequencies in the 
20 band, BJ/a) has a value equivalent to the Gaussian window weight (qjq) = 1.5. As 
frequency increases, H, 2 (w) for the two end sensors (m=12), shown as curve 48, 
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implemented using charge-coupled device (CCD), bucket brigade device (BBD) 
or switched-capacitor (SC) transversal filter technology or perhaps a linear-phase 
transconductance capacitor filter. The inventors have successfully implemented a 
CMOS 3-order Bessel transconductance capacitor filter bank and a BBD 
5 beamformer with 15 microphone inputs and 6 beams, so single chip integration 
should be possible without undue experimentation. 

Fig. 12 provides a summary of the signal discrimination procedure of this 
invention. In the first step 76, the K sensors each receive a linear combination of 
I source signals {S^t)} in the manner discussed hereinabove. In the next step 78, 

10 a sensor signal E^t) is created responsive to the received signals at each of K 
sensors in the sensor array. These sensor signals are then shaded by multiplying 
each by a scalar weighting factor b k in step 80. If the source signals are 
broadband, then step 82 is added to equalize the array over a predetermined 
frequency range by filtering each sensor signal E^t) through a filter function H^w) 

15 selected according to the method discussed above in connection with Figs. 9-10. 
Equalizing step 82 is followed by a beamfonning step 84 wherein J beam signals 
{Bj(t)} are each created by delaying the filtered sensor output signals according to 
a j* phasing vector \fi k ] } and summing them to form the j* spatial beam signal. 
The J>I spatial beam signals are then presented to an I by I HJ network. 

20 Initially, the HJ network transform matrix [C y ] is assumed populated with zero- 
valued elements {c^} in step 86. With these assumed values, the HJ network then 
creates I estimated source signals {Yj(t)> in accordance with step 88 in Fig. 12. 
These estimated source signals are then immediately displayed as initial solutions 
to the blind source separation problem in step 90. After the first estimated source 

25 signals {Yj(t)} are available, a transform increment signal Ac^Cj/dt is created 
(according to Eqn. 4) in step 92 for each element of the HJ transform matrix [C y ]. 
The HJ transform matrix elements {c^} are then updated in step 94 in accordance 
with the increment signals {Ac^}. After the updated element values of [C y ] are 
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available, control is returned to step 88 and new estimated source signals {Yj(t)> 
are generated accordingly. These are also displayed in step 90. 

It should be appreciated that the series of steps illustrated in Fig. 12 are 
performed continuously and are amenable to either continuous analog performance 
5 or incremental performance in discrete time. 

Inventor Simulation Results 

The inventors simulated a 2x2 HJ network with a 2-beam array for a 2-path 
channel. The array had 2M+1 = 25 sensors. One formed beam is aimed at zero 
degrees and the other beam is aimed at 10 degrees, relative to airay normal. The 

10 simulated direct path source signal S, arrives from two degrees and the reflected 
path source signal S 2 arrives from eight degjrees with a delay of 12.75 ms. The 
source signal used in the simulation is a biphase-shift-keying (BPSK) signal and 
the carrier frequency is 14 kHz. The bit rate is 5 kB. The frequency operating 
band is w a =5 kHz to 0^=20 kHz. The filter bank consists of 21 -tap finite-impulse- 

15 response (FIR) digital filters designed to realize the ^(w) shown in Eqn. 14. Fig. 
10 shows the output beam power of the resulting beamformer, which is 
substantially constant over the predetermined frequency range. The simulation was 
carried out in the time domain. The carrier synchronization uses a matched filter 
to convolve the received signal with a time-reversed replica of the transmitted 

20 signal. 

As the delay time between the different paths increases, unlike the 
conventional equalization filter that requires additional taps, there is no penalty in 
the system of this invention because the signal and its delayed versions are treated 
as two uncorrelated signals. That is, the information in the signal bandwidth and 
25 the angle-of-arrival is sufficient to resolve the two different signal paths. Time 
" delay estimation, which is difficult in underwater channels, can be performed after 
the multipath signals are detected in this example. The primary signal and its 
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multipath "ghosts" can be considered as uncorrected when the multipath delay is 
longer than a symbol length and there is no correlation between adjacent bits 
transmitted. If the adjacent bits prove to be correlated, decorrelation may be 
achieved by modulating the transmitted bit train with a pseudorandom train that 
5 has the same bit rate as the data. When the delay time is smaller than the symbol 
length, which is 0.2 ms in this simulation example, the HJ network cannot 
generally converge. Thus, for short delay times, the spread-spectrum technique 
should be used to reduce the symbol length. Practically, the long delay times are 
of more concern than very short delay times. A 0.2 ms delay represents only a 6.8 

10 cm path length difference in air and 30 cm in water. These short lengths are 
further decreased at higher signal bit rates. 

Fig. 13 shows the adaptation process of the 2x2 HJ network used to process 
the two spatial beam outputs of the simulated 25-element array. The two 
transform signals c 12 and Cj, are shown plotted as ordinate and abscissa, 

15 respectively. These are set to zero at the beginning of the adaptation. The adaptor 
functions are defined as f(s) = s 3 and g(s) = s for c l2 and c 2l in the HJ network 
simulation. The adaptation rate parameter is set to fi = 0.2 (see Eqn. 4). 

Two types of white noise is considered in the simulation. One is the noise 
associated with the source signal, which can be treated as an independent signal 

20 if it is strong enough. The other is non-directional noise that includes the 
surrounding noise field in the channel and the electronic noise from the receive 

circuitry. With these noise sources, Eqn. 7 becomes: 

* • 

£(0M[^(0 + ^i(0^2(0 Pqn. 18] 

where W,(t) and W 2 (t) are independent white Gaussian random vectors with the 
25 power spectral densities S w , and S^, respectively. The signal-to-noise ratios 
used in the simulation are 10 log 10 (S/S wl ) = 7 dB and 10 log 10 (S/S w2 ) = 27 dB. 
Note that the quantities c 12 and quickly converge to stable and correct values 
in Fig. 13. 
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Fig. 7A shows the detection of an exemplary bit train using only the zero 
degree beam output signal. The detection is of a BPSK data stream of 512 bits 
spanning 0.1 seconds using only the beam aimed at zero degrees without filter 
equalization. When a bit is transmitted correctly, there is a plus located at zero. 
5 There were five bit errors 101 shown in the lower panel of Fig. 7A, which is a bit 
error rate (BER) = 5/512. 

Fig. 7B shows the detection of the same bit train using one of the HJ 
network outputs. The first 30 data bits are received with about the same BER as 
in Fig. 7A. After the HJ network converges, the transmission is error-free. 
10 Similar results were noted for the other beam output signal. 

Inventor simulation results show that when the adaptation rate parameter 
fi is increased, the adaptation speed increases but the fluctuation of the final values 
of c 12 and c^ about the correct values also increases. Thus, there is a trade-off 
between the adaptation speed parameter fi and the separation accuracy. When the 
15 direction of signal arrivals in the underwater acoustic channels rapidly change, the 
degree of separation suffers. In the simulation, c 12 and c^ adapted from random 
initial conditions to their correct values within 10 to 20 ms. Thus, the system of 
this invention is fast enough to handle time-variant fading in reverberant 

underwater acoustic channels. 

* 

20 The method of this invention can be used in underwater acoustic 

communications where several constantly changing paths usually exist, resulting 
in severe intersymbol interference (ISI) in the data link. Unlike other methods 
proposed for reducing ISI and multipath fading channels through treating the other 
multipath signals as noise or through high computational loads resulting in long 

25 delays, the system of this invention can recover information from each path 
without using training signals. It is therefore possible to achieve faster signal 
transmission rates than with other methods. Inventor simulations show that the 
system of this invention can significantly reduce the data error rate (Fig. 7B) and 
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is a practical approach to reliable high-speed acoustic telemetry. Also, in the 
"cocktail party" problem, the system of this invention can be used to separate 
various voice and music sources in a video-conferencing system. Although the HJ 
network is preferred, other adaptation methods may also be usefully applied to the 
5 system of this invention. 

Analog implementation should be realizable in a single analog VLSI chip, 
forming a very compact system. Digital implementation is suitable for the 
"cocktail party" problem requiring a relatively low sampling rate for audio 
frequencies. The system of this invention may be applied to broadband channels 

10 by linking multiple narrower band beamformer and HJ network arrays together. 

Clearly, other embodiments and modifications of our invention will occur 
readily to those of ordinary skill in the art in view of these teachings. Therefore, 
our invention is to be limited only by the following claims, which include all such 
embodiments and modifications when viewed in conjunction with the above 

15 specification and accompanying drawing. 
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CLAIMS 

1. A method for recovering at least one of a plurality I of source 
signals {SJ, each said source signal arriving at a receiver from one of a 
plurality J of directions {Dj}, said receiver including a plurality K of sensors each 
having a sensor output signal E k , wherein i, j and k are non-zero positive integers 
and I, J and K are positive integers greater than unity, said method comprising: 

creating a plurality K of said sensor output signals {E k } responsive to said 
plurality I of source signals {SJ; 

multiplying said sensor output signals {E k } by predetermined shading 
factors {b k } to create a plurality K of shaded sensor output signals {b^}; 

delaying said shaded sensor output signals {b^} by means of a plurality 
J of phasing vectors [jSJj to produce a plurality JK of delayed shaded sensor 
output signals [bkEJj and combining said delayed shaded sensor output signals to 
create a plurality J of spatial beam signals {3$ such that B } = £ b k E k (t-k k &wfi£ , 
wherein t is time and \ is a predetermined constant; and * =1 

producing an estimated source signal Y { at an output such that Y i = eBj, 
wherein said estimated source signal Y { corresponds to said at least one source 
signal S b e is a predetermined constant, and said shaded sensor output signals 
{b k EJ are filtered by means^pf a filter characteristic H k (a>) substantially 
equivalent to H k ((x>)=y(u)e fl < u )+8(o>) wherein a(a>), and 7(05) are 

predetermined functions of frequency co selected such that each said spatial beam 
signal Bj is unchanging over a predetermined continuous frequency band. 

2. The method of Claim 1 wherein said predetermined functions a((o) 9 
5(o?) and y(a>) are selected such that 

\t2 ; 



[a(ca),$(cD),Y(cD] =a7g min 



k I d£ ± 
Y,\e a °cos(fca) 0 T)-(YC 0 +5)cos(to T ) ; 
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wherein t is a steering angle time delay in the interval [0, r 0 ], said interval 
including delays for said plurality J of directions {Dj}, o> 0 is a frequency within 
said predetermined continuous frequency band, a 0 = a(a> 0 ), a = a(o>), 8 = 5(a)), and 
7 - Y(*>). 

5 3. The method of Claim 2 wherein said receiver comprises K=2M+1 

sensor elements uniformly spaced in a line, wherein M is a non-zero positive 
integer. 

4. The method of Claim 1 wherein said producing step further 
incorporates the step of: 

10 updating a plurality of transform signals {c^} by means of successive 

approximation to create an adaptive transform matrix [CJ such that said estimated 
source signal Y { = efC^JBj]. 

5. A method for recovering at least one of a plurality I of source 
signals {SJ in a communications system, wherein each said source signal Sj arrives 

15 at a receiver from one of a plurality J of directions {Dj}, said receiver including 
a plurality K of sensors each having a sensor output signal where i, j and k are 
nonzero positive integers and I, J and K are positive integers greater than unity, 
said method comprising: 

creating a plurality K of said sensor output signals {EJ in response to said 
20 plurality I of source signals {SJ; 

creating a plurality J of spatial beam signals {Bj} in response to said sensor 
output signals {EJ such that B^^bfiffi-Xfiwf}.), wherein t is time and /L, 
bk and X k are predetermined constants; and 

producing one or more of said estimated source signals {YJ in response 
25 to said plurality J of spatial beam signals {Bj} and a plurality I J of transform 
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signals {cjj, wherein each estimated source signal Yj corresponds to one of said 
source signals {SJ and said plurality U of transform signals {cy} corresponds to 
a transform matrix updated by successive approximation of a plurality I of 
estimated source signals {YJ and by successive addition to each said transform 
5 signal Cj; of an increment signal Ac }l = (-/x)f(Yj)g(Yj), wherein [YJ = [I+CjJ* 1 [Bj], 
[t\ is the unit matrix, ji is a predetermined constant and f(x) and g(x) are 
predetermined odd functions of x. 

6. A method for recovering at least one of a plurality I of source 
signals {SJ, each said source signal Sj arriving at a receiver from one of a 
10 plurality J of directions {DJ, said receiver including a plurality K of sensors each 
having a sensor output signal E^,, wherein i, j and k are nonzero positive integers 
and I, J and K are positive integers greater than unity, said method comprising: 
creating a plurality K of said sensor output signals {E k } responsive to said 
plurality I of source signals {SJ; 
15 multiplying said sensor output signals {E k } by predetermined shading 

factors {b k } to create a plurality K of shaded sensor output signals {b^}; 

delaying said shaded sensor output signals {b^} by means of a plurality 
J of phasing vectors {fi Jj to produce a plurality J K of delayed shaded sensor 
output signals [bfcEJj and combining said delayed shaded sensor output signals to 
20 create a plurality J of spatial beam signals {Bj}; and 
repeatedly performing the steps of 

combining said spatial beam signals {B,} to create a plurality I of 
estimated source signals {YJ so that [YJ « [I+CjJ" 1 [Bj], wherein [I] is the 
unit matrix and [CjJ is an adaptive transform matrix corresponding to a 
25 plurality JK of transform signals {c^}; 

adjusting said transform signals {c$ in response to said estimated 
source signals {YJ to correct said adaptive transform matrix [CjJ; and 
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producing at least one of said estimated source signals {YJ, 
wherein said produced estimated source signal corresponds to said at least 
one of said source signals {SJ. 

7. The method of Claim 6 wherein: 

5 said delaying step is performed such that said spatial beam signal 

^rljbJSifi-Xjpinfiig) , wherein t is time and \ is a predetermined constant; and 
said adjusting step is performed such that each of said transform signals 
{cji} is adjusted by an increment signal Acjj = (ji)f(Y$g(Y*X wherein fi is a 
predetermined constant and f(x) and g(x) are predetermined odd functions of x, 
10 respectively. 

8. The method of Claim 7 further comprising: 

filtering said shaded sensor output signals {b^} by means of a filter 

-k 2 

characteristic H k (a>) substantially equivalent to H k (u>)=y(<o)e a(w > +5(a>), 

wherein a(cu), 5(a)), and y(oj) are predetermined functions of frequency a> selected 
15 such that each spatial beam signal B } is unchanging over a predetermined 
continuous frequency band. 

9. The method of Claim 8 wherein said predetermined functions a(ci>), 
5(co) and 7(0?) are selected such that 

r ° 

a(a)),8(co),y((i))]=fl^ min / £ \e a ° cos(kto o T)-(ye a +5)cos(fco)T) dr 
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wherein t is a steering angle time delay in the interval [0, tJ, said interval 
including delays for said plurality J of directions {Dj}, to 0 is a frequency within 
said predetermined continuous frequency band, a 0 = a(o) 0 ), a = a(co), 6 = 6(a)), and 
7 = 7(cd). 

5 10. The method of Claim 6 wherein said receiver comprises K = 2M + 

1 sensor elements uniformly spaced in a line, wherein M is a nonzero positive 
integer. 

11. A system for separating a plurality I of source signals {S} 9 each 
said source signal S { arriving from one of a plurality J of directions {Dj}, said 
10 system comprising: 

sensor array means having a plurality K of sensors for receiving said source 
signals {SJ; 

transducer means in each sensor for creating a sensor output signal E k in 
response to plurality I of source signals {SJ; 
15 beamformer means coupled to said sensor array means for creating a 

plurality J of spatial beam signals {Bj} in response to said plurality K of sensor 
output signals {EJ; 

broadband shading means coupled to said sensor array means for adjusting 
said plurality K of sensor output signals {EJ over a predetermined frequency band 
20 for equalizing the amplitude response of said sensor array means over said 
predetermined frequency band; and 

output means coupled to said beamformer means and said broadband 
shading means for generating a plurality I of output signals { corresponding to 
estimates of said source signals {SJ, wherein i, j and k are nonzero positive 
25 integers and I, J and K are positive integers greater than unity. 
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12. The system of Claim 11 wherein said broadband shading means 
comprises a plurality K of filter means having filter characteristics {H k (co)}, 

wherein H k (u>) = Y (&)e a(w) +S(a)), wherein a(a>), 6(a)), and 7(a)) are 

predetermined functions of frequency 0 selected such that each said spatial beam 
5 signal Bj is unchanging over said predetermined continuous frequency band. 

13. The system of Claim 12 wherein said predetermined functions 
6(a) and yfa) are selected such that 

T °Ak ( d£ VI 2 

a(co),5(o)),Y(o))]=fl7y min \ \ J^[e a ° cos(ku> o r)-(ye a +5)cos(fccoT)J dr 



herein 7 is a steering angle time delay in the interval [0, rj, said interval 
10 including delays for said plurality J of directions {Dj} 5 &> 0 is a frequency within 
said predetermined continuous frequency band, a 0 = a(w 0 ), a = 8 = 5(w), and 
T = 7 ((o). 

14. A system for separating a plurality I of source signals {SJ, each 
said source signal Sj arriving from one of a plurality J of directions {Dj}, said 
15 system comprising: 

sensor array means having a plurality K of sensors for receiving said source 
signals {SJ; 

transducer means in each sensor for creating a sensor output signal in 
response to said plurality I of source signals {SJ; 
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beamformer means coupled to said sensor array means for creating a 
plurality J of spatial beam signals {Bj} in response to said plurality K of sensor 
output signals {EJ; 

transform means coupled to said beamformer means for creating and storing 
5 a plurality IJ of transform signals {CjJ corresponding to an adaptive transform 
matrix [CJ; 

output means coupled to said beamformer means and said transform means 
for generating a plurality I of output signals {Y { } corresponding to estimates of 
said source signals {SJ such that [YJ = [I+Cj]" 1 [BJ, wherein [T| is the unit 
10 matrix; and 

adaptive transform means coupled to said output means and said transform 
means for adjusting each of said plurality IJ of transform signals {c } } in response 
to an increment signal Ac }i = (^fOQgOQ, wherein fi is a predetermined constant 
and f(x) and g(x) are predetermined odd functions of x, wherein i, j and k are 
15 nonzero positive integers and I, J and K are positive integers greater than unity. 

15. The system of Claim 14 wherein said plurality K of sensors are 
disposed on a plane and said beamformer means creates said plurality J of spatial 
beam signals {Bj} such that Bj=^bJZ k (t-XjpinflJ) for said direction Dj, wherein 
t is time and 0^, \ and b* are predetermined constants. 

20 16. The system of Claim 15 wherein said plurality K = 2M+ 1, wherein 

Mis a nonzero positive integer. 



17. The system of Claim 14 further comprising: 
broadband shading means coupled to said sensor array means for adjusting 
said plurality K of sensor output signals {EJ over a predetermined frequency band 
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for equalizing the amplitude response of said sensor array means over said 
predetermined frequency band. 

18. The system of Claim 17 wherein said broadband shading means 
comprises a plurality of finite-impulse-response filters each coupled to at least one 

5 of said plurality K of sensors. 

19. The system of Claim 14 wherein said plurality I of source signals 
{SJ comprises acoustic signals and said sensor array means comprises a plurality 
of acoustic transducers. 

20. The system of Claim 14 wherein said plurality I of source signals 
10 {SJ comprises electromagnetic signals and said sensor array means comprises a 

plurality of antenna elements. 

21. A system for adaptive cancellation of one or more interferer signals 
{SJ in a signal receiver having a sensor array with a plurality K of sensors, said 
system comprising: 

15 transducer means in each sensor for creating a sensor output signal in 

response to a plurality I of said interferer signals {SJ; 

beamformer means coupled to said sensor array for creating a plurality J 
of spatial beam signals {Bj} in response to said plurality K of sensor output signals 
{EJ; 

20 transform means coupled to said beamformer means for creating and storing 

a plurality I J of transform signals {CjJ corresponding to an adaptive transform 
matrix [CJ; 

output means coupled to said beamformer means and said transform means 
fo'r generating a plurality I of output signals {YJ corresponding to estimates of 
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said interferer signals {SJ such that [YJ = [I+CjJ" 1 [Bj], wherein [I\ is the unit 
matrix; and 

adaptive transform means coupled to said output means and said transform 
means for adjusting each of said plurality U of transform signals {c^} in response 
5 to an increment signal Aty « fci)f(Yj)g(Yj), wherein f(x) and g(x) are 
predetermined odd functions of x, fi is a predetermined constant, i, j and k are 
nonzero positive integers and I, J and K are positive integers greater than unity. 

22. The system of Claim 21 wherein said plurality K of sensors are 
disposed on a plane and said beamformer means creates said plurality J of spatial 

K 

10 beam signals {Bj} such that b k E k (t-k k sin P kJ ) for said direction Dj, 

wherein t is time and ft^ \ and 1^ are predetermined constants. 

23. The system of Claim 22 wherein said plurality K = 2M + 1, wherein 
M is a nonzero positive integer. 

24. The system of Claim 21 further comprising: 

15 broadband shading means coupled to said sensor array means for adjusting 

said plurality K of sensor output signals {E k } over a predetermined frequency band 
to equalize the amplitude response of said sensor array means over said 
predetermined frequency band. 

25. The system of Claim 24 wherein said broadband shading means 
20 comprises a plurality of finite-impulse-response filters each coupled to at least one 

of said plurality K of sensors. 
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26. A system for separating a plurality I of source signals {SJ in an 
underwater acoustic communications system, each said source signal Sj arriving 
from one of a plurality J of directions {DJ, said system comprising: 

sensor array means having a plurality K of acoustic sensors for receiving 
5 said plurality I of source signals {SJ; 

transducer means in each acoustic sensor for creating a sensor output signal 
in response to said plurality I of source signals {SJ; 

beamfonner means coupled to said sensor array means for creating a 
plurality J of spatial beam signals {BJ in response to said plurality K of sensor 
10 output signals {EJ; 

transform means coupled to said beamfonner means for creating and storing 
a plurality I J of transform signals {cjj corresponding to an adaptive transform 
matrix [CjJ; 

output means coupled to said beamfonner means and said transform means 
15 for generating a plurality I of output signals {YJ corresponding to estimates of 
said source signals {SJ such that [YJ = [I+CjJ" 1 [BJ, wherein [I] is the unit 
matrix; and 

adaptive transform means coupled to said output means and said transform 
means for adjusting each of said plurality I J of transform signals {cj J in response 
20 to an increment signal Ac^ = (y)f(Yj)g(Yj), wherein f(x) and g(x) are 
predetermined odd functions of x, H is a predetermined constant, i, j and k are 
nonzero positive integers and I, J and K are positive integers greater than unity. 

27. A system for separating a plurality I of source signals {SJ in a 
cellular telecommunication system, each said source signal S; arriving from one of 

25 a plurality J of directions {DJ, said system comprising: 

sensor array means having a plurality K of antenna elements for receiving 
said plurality I of source signals {SJ; 
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transducer means in each antenna element for creating a sensor output 
signal Efc in response to said plurality I of source signals {SJ; 

beamfonner means coupled to said sensor array means for creating a 
plurality J of spatial beam signals {Bj} in response to said plurality K of sensor 
5 output signals {EJ; 

transform means coupled to said beamfonner means for creating and storing 
a plurality I J of transform signals {c^} corresponding to an adaptive transform 
matrix [Cy; 

output means coupled to said beamfonner means and said transform means 
10 for generating a plurality I of output signals {Y { } conesponding to estimates of 
said source signals {SJ such that [YJ = P+Cjj* 1 [Bj], wherein [I\ is the unit 
matrix; and 

adaptive transform means coupled to said output means and said transform 
means for adjusting each of said plurality I J of transform signals {cjj in response 
15 to an increment signal ACjj = GOfCY^gOQ, wherein f(x) and g(x) are 
predetermined odd functions of x, p is a predetermined constant, i, j and k are 
nonzero positive integers and I, J and K are positive integers greater than unity. 
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